Skip to content

Conversation

slice4e
Copy link

@slice4e slice4e commented Feb 23, 2024

Downloading large files (e.g. 100M vectors) sometimes fails.
This adds a retry capability.

@slice4e slice4e marked this pull request as draft February 25, 2024 04:02
@slice4e
Copy link
Author

slice4e commented Feb 25, 2024

This approach still has problems. While it attempts to retry - it just makes the download fail multiple times, which causes free disk space to go down to 0. A better approach is needed - where an interrupted download can continue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant